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Abstract 

The linear response framework was established a half-century ago, but 
no persuasive direct derivation of entropy production has been given in this 
scheme. This long-term puzzle has now been solved in the present paper. 
The irreversible part of the entropy production in the present theory is given 
by (dS/dt)i TT = (dU/dt)/T with the internal energy U(t) of the relevant 
system. Here, U(t) = ("Ho)t — TrH p(t) for the Hamiltonian "H in the 
absence of an external force and for the density matrix p(t). As is well 
known, we have (dS/dt) irr = if we use the linear-order density matrix 
Pir(t) = Po + Pi{t)- Surprisingly, the correct entropy production is given by 
the second-order symmetric term p2(t) as (dS/dt) irr = (l/T)Ti'H p' 2 (t). This 
is shown to agree with the ordinary expression J ■ E/T = aE 2 /T in the 
case of electric conduction for a static electric field E, using the relations 
TrHof/ 2 (t) = -Tr-Hi(t)piO) = TrA • Ep x (t) = J E (Joule heat), which 
are derived from the second-order von Neumann equation ihdp 2 (t)/dt = 
[Ho, p2(t)] + [Hi(t), pi(t)]. Here %i(t) denotes the partial Hamiltonian due 
to the external force such as Hi(t) = — e J?. t% ■ E = —A ■ E in electric 
conduction. Thus, the linear response scheme is not closed within the first 
order of an external force, in order to manifest the irreversibility of transport 
phenomena. New schemes of steady states are also presented by introducing 
relaxation-type (symmetry-separated) von Neumann equations. The con- 
cept of stationary temperature T st is introduced, which is a function of the 
relaxation time r r characterizing the rate of extracting heat outside from 
the system. The entropy production in this steady state depends on the 
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relaxation time. A dynamical-derivative representation method to reveal 
the irreversibility of steady states is also proposed. The present derivation 
of entropy production is directly based on the first principles of using the 
projected density matrix p2{t) or more generally symmetric density matrix 
p sym (t), while the previous standard argument is due to the thermodynamic 
energy balance. This new derivation clarifies conceptually the physics of ir- 
reversibility in transport phenomena, using the symmetry of non-equilibrium 
states, and this manifests the duality of current and entropy production. 

Keywords: irreversibility, symmetry, first-principle, linear response, 
electric conduction, entropy production, transport phenomena, projected 
von Neumann equation, steady states, stationary temperature 



1. Introduction 

The basic problems of irreversibility and transport phenomena have been 
discussed for many years from many viewpoints[l-12] . Boltzmann's if -theorem 
shows the first attempt to explain the broken symmetry of entropy change in 
time, namely irreversibility, even though it is based on stochastic equations 
(such as the Boltzmann equation). On the other hand, transport phenom- 
ena were studied phenomenologically first by Einstein in 1905, and later by 



Onsager|13l. [14J. Green[3] formulated transport coefficients using stochastic 
equations including the time change of microscopic fluctuations [5j. Kubo 
and Tomita[8| succeeded, for the first time, in formulating magnetic linear 
responses on the basis of the von Neumann equation. Nakano[9| applied 
Kubo-Tomita's method to the problem of electric conduction, though the 
two problems had been regarded to be different in the sense that the former 
is reduced to an equilibrium problem for zero frequency limit, but the latter 
is still in non-equilibrium even for the static limit (lOj. Kubo|4j established a 
general theory of linear responses including the magnetic response and elec- 
tric conduction, as is briefly reviewed in Section 2. Previous arguments on 
the energy dissipation and entropy production in the linear response scheme 
are summarized in Section 3. First-principles derivation of entropy produc- 
tion due to the symmetric part of the density matrix is given in Section 4, 
in order to clarify conceptually irreversibility in transport phenomena as an 
example of static electric conduction. In Section 5, new schemes of steady 
states and entropy production are presented by introducing relaxation-type 
von Neumann equations. In Section 6, the dynamical-derivative representa- 
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tion method is proposed to derive the entropy production of steady states. 
A summary and discussion are given in Section 7. 



2. Brief review of the linear response scheme with reference to 
irreversibility 



As in Kubo's paper [4J, we start with the following von Neumann equation 
for the density matrix p(t): 

ih^p(t) = m), P (t)}, (i) 

where the total Hamiltonian is given by 

H(t) =U + U 1 (ty, U x (t) = -A-F{t). (2) 



For the physical meaning of "Ho, see Kubo's paper[4| and Section 4 (below 
Eq.( l25|) ). Even the conductivity ( flUj) is expressed only by "Ho as well as the 
current operator j. Now we expand p(t) as 

Pir(t) = Po + Pi(t); Po = e-P Ho /Z Q (/3) (3) 

with Z (f3) = Tr exp(— (3T-Lq), up to the first order of an external force F. 
Then, we have 

^PiW = [Mo,Pi(t)] + [fti(*),A>]- (4) 
The solution of this equation is given by 

Pl (t)= [ Uo(t-s)Un l (s),p }Ui(t-s)ds (5) 

with the unitary operator U^it — s) defined by 

U Q (t -s)= exp (l^JLuA . (6) 



Using Kubo's identity|4j or the quantum derivative 15 



[A } e^ n °]=e-^ Ho [ e xn °[H ,A]e- XUo d\ 
Jo 



r/3 

-ihe- m ° I e xn °Ae- xn °d\ 



-ihe- m ° / A{-ih\)d\ (7) 
Jo 
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the first-order density matrix p\{t) is expressed as 



p 1 (t)=p f ds f d\F(s) ■ A(s-t-ihX), (8) 

Jt Jo 

where A denotes the current j of A, namely j — A — [A,7io]/ifi- Finally, 
we arrive at the well-known formula m. M 



(j)t = Tr{(po + Pi(t))j} 
ft r P 



't {l 

which is reduced to 



( ds I d\(jj(t - s + ih\)) F(s), (9a) 

Jtn JO 



poo pp 

J= ds d\e- es (jj(s + ih\)) F(t- s) (9b) 
Jo Jo 

by taking the limit to — * ~°° after the thermodynamic limit. The order of the 
above two limiting procedures and the adiabatic factor e~ es are vital to assure 
the non- vanishing value of the current, namely to realize the irreversibility 
in transport phenomena, as will be shown in Section 4. In particular, for the 
static electric conduction F(t) = .E(constant), we have 

/•oo p/3 

J = aE; a= dt d\e~ et (jj(t + ih\)) (10) 
Jo Jo 

with the current j = A and A = e ^ • Vj. The finiteness (a > 0) of this 
expression is important to discuss later the entropy production and irre- 
versibility in electric conduction from the first-principles based on the von 
Neumann equation. Note that this condition of finiteness (a > 0) is violated 
in the opposite limit to — oo for a finite volume in Eq. (l9a| . because we 
obtain a oc TrA[A,p ] = by integrating A(t) = j(t) in Eq. ([9"aj) with Eq.Q 
with respect to time t in this unphysical condition. 



3. Previous arguments on the energy dissipation and entropy pro- 
duction in the linear response scheme 

The problem of entropy production is very subtle even in the linear 
response scheme. The first puzzle is that the ordinary formula S(t) = 
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— k-Q^pif) log p{t) is useless for our purpose, because it is time-independent, 
as is well known. There have been many arguments proposed on the energy 
dissipation and entropy production in the linear response scheme. 

Some typical arguments are briefly reviewed in order to clarify how in- 
sufficient they are from the present new point of view. 

3.1. Thermodynamic derivation of energy dissipation based on energy balance 
in a steady state 

The energy conservation law yields the following balance equation of the 
change of the internal energy dU in the form 

dU = AQ + AW } (11) 

where AQ is the heat transferred to the system during the process of change, 
and AW{= J ■ E per unit time) denotes the work done by the force (electric 
field E) on the system. The internal energy is assumed to be constant, 
namely dU = to keep the temperature of the system constant. Note that 

U[ v {t) = j t TrHoMt) = Tr?Vi(t) = (12) 

using the expression (JHJ). In this sense, at a glance the above proposition 
dU = seems to be appropriate. Then, we have —AQ = AW — J E — aE 2 . 
This is the so-called Joule heat |AQ|, or energy dissipation transferred to the 
heat reservoir. This argument seems to be natural, because the amount of 
the dissipated energy \AQ\ = aE 2 is correct. However, in order to realize the 
above situation in which the system is stationary, namely the temperature T 
is constant, we have to modify the von Neumann equation (pQ) by introducing 
an appropriate interaction with the heat reservoir and boundary conditions. 
This modification is not so simple, as has been tried by many people. 

If we avoid such complication of modification, then we are able to ac- 
complish our goal to understand clearly the mechanism or essence of irre- 
versibility in transport phenomena, namely to derive directly the entropy 
production (dS/dt)^ = U 1 it) /Tit) from the first-principles using the von 
Neumann equation (JT]). This will be presented in the succeeding section. 

3.2. Primitive try to derive entropy production from Sit) = — /cBTrp(t) log p(t) 
approximating pit) by the linear density matrix p\ T (t) 

One expects to derive a correct expression of entropy change from 

S lT (t) = -k B Tr{p + Pl it)) log(p + Pi(t)), (13) 
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but the time derivative of this entropy calculated up to the second order of the 
electric field E is not equal to aE 2 /T. The reason of this discrepancy will be- 
come clear in the succeeding section. It should also be noted that the expres- 
sion f fl3|) depends on time t, while the expression S(t) = — A;eTrp(t) log p(t) 
does not as mentioned before. (The introduction of approximation (in the 
first order of E) is expected to yield irreversibility, for it sometimes corre- 
sponds to the contraction of information.) 

3.3. Zubarev-type argument with a "negative sign" problem 

Zubarev extended the linear response scheme to a non-linear regime by 



introducing a non-equilibrium statistical operator of the form 11 



p Zub (t) = exp (-0>(t) -PHo + P f dse< s -^j(s - t) ■ E^j 

^pUt) + ---=p + Pi{t) + --- (14) 

in the case of static electric conduction. (Zubarev discussed a general case.) 
That is, pzub(^) agrees with pi r (t) = po + pi(t) as far as the linear term is con- 
cerned, and conversely the former can be constructed so that the expanded 
series of the exponential part of it may agree with p\ r (t) up to first order. 
Zubarev defined the entropy SzubW °f this system by 

Szvb(t) = -k B Tip Zuh (t) logpi oc , (15) 

where 

p loc = e'^ Ho+H ^/Z(P); Z{fi) = Tre^ 0+ ^ (16) 

in the present problem with 7-L\ = —A-E in static electric conduction. Then, 
his entropy production is expressed as 

|4 1 ubW = ^Tr(H + H 1 )p' Zub (t). (17) 

In the limit of the linear response scheme, this is reduced to 

= ^™ lP >M (18) 

because of the different symmetries of Ho and pi(t). Thus, Zubarev erro- 
neously concluded that the entropy production (Tl8|l is given by o~E 2 /T(> 0), 
at least, in the linear response regime. However, as will be seen from the third 
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last expression of the right-hand side of Eq.( 13"3"j) in the succeeding section, 
the correct calculation of Eq.f llSp yields the negative value —aE 2 /T. The 
discrepancy of the above two results may come from the following situation. 
In the standard treatment of the non-equilibrium average (Q)t = TrQp(t) for 
any observable Q, the time derivative of it is expressed in the following two 
ways: 

j t (Q) t = TrQp'(t)=Tr^p(t), (19) 
where dQ/dt is given by 

with 7i{t) = T-Lq + Hi(t). (This derivative of Q will be denoted later as D&Q 
in Eq. floT]) .) On the other hand, such an operator f(p(t)) as the "entropy 
operator" log p(t) obeys the von Neumann -like equation 

ihp(p(t)) = [H(t)J(p(t))} } (21) 



as is easily proved for any analytic function f(x) [11|, [15] . If the time derivative 
of the operator logpi oc is interpreted incorrectly as in Eq.( l2~Tj) . an incorrect 
sign is realized to appear in the calculation, favorable to Zubarev's theory. 

3.4- Relative- entropy formulation 

The relative entropy S re \(t) defined by 

S iel = -k B Tip(t) (log p(t) - log p loc ) (22) 

will be often used to discuss the entropy change. This yields 

4<M*) = k Bj t (Trp(t) logp loc ) . (23) 



j f S^(t) = —Tr-HMt) (24) 



Then, we obtain 



in the linear response scheme. This has a correct sign in contrast to Eq. (fr8l) . 
However, this usage of the definition (1221) is regarded to be only a trick to 
change the wrong sign to the correct one, from our new point of view! There 
is no physical justification for utilizing the relative entropy (T22]) in order to 
discuss the irreversibility, namely the entropy production. In fact, Eq. (T23l) 
always vanishes, if we include higher-order terms of p(t) as will be seen in 
Section 7. 
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3. 5. Variational theory of the entropy production 

Onsagar and Machlup discussed phenomenologically linear transport 
phenomena, using the variational theory concerning the bilinear form of the 
energy dissipation with respect to the current. This phenomeno logical the- 
ory is, from the beginning, based on the correct expression of the entropy 
production. Later, Nakano 10[ developed a variational theory of energy dis- 
sipation based on his microscopic expression of conductivity, by extending 



Schwinger's theory [16 



4. First-principle derivation of entropy production in the linear 
and non-linear transport phenomena by symmetry separation 

In order to clarify the essence of the irreversibility, namely entropy pro- 
duction in transport phenomena, we concentrate our arguments here on a 
non-stationary process in static electric conduction described by the Hamil- 
tonian 

H = Ho + H 1 ; n x = -A- E and A = eJ2 r j- ( 25 ) 

j 

Here, "Ho denotes the Hamiltonian of electrons together with impurity 
potentials to scatter electrons or with electron-phonon interactions. Thus, 
Hq is assumed here to be symmetric with respect to the inversion of space 
(r — > —r or spin inversion Sj — > —Sj in the case of magnetic responses), 
while 7ii is antisymmetric. Therefore, the average (Ho)t = TrHopit) can be 
regarded to be such an internal energy U (t) as is identified as the heat energy 
of the relevant system, for the initial state po is given by the equilibrium 
density matrix without an electric field. Such a Hamiltonian T-L' Q as stores 
electrons in a static way inside (or at the surface) of the system may be added 
to "Ho- (Note that "Hq is not a time derivative of "Ho-) However, this may 
have a symmetry different from "H 0) an d it is regarded not to contribute to 
the motion of electrons and consequently the time derivative A is still given 
only by H as A = lA,7-Lo]/ih without using 7i' , and T-L' is also assumed to 
be commutable with Then, our following arguments still hold. (Only 
the energy balance changes: The (input) electric power becomes equal to the 
sum of the Joule heat (J E -E) and d(T-L' ) t /dt.) These yield a finite (non-zero) 
value of the conductivity o. This finiteness of a gives the positive entropy 
production. See Appendices A and B for intuitive arguments of the role of Hq 
in our theory of irreversibility and entropy production. The vanishing a in a 
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random quantum system with impurity potentials corresponds to Anderson 



localization. (See ref.(l7j|) 

Physically, the internal energy U(t) of the system increases owing to the 
applied electric field (or power), that is, the system heats up in the present 
non-stationary situation. Thus, the temperature T of the system depends on 
time t as T = T(t). (This time dependence will be defined later.) This is the 
essence of irreversibility in the electric conduction phenomenon. Thermody- 
namically, the entropy change dS is given by dS = dll/T using the internal 
energy change dU. Correspondingly, the entropy production (dS/dt\ TT in- 
trinsically produced inside the system by the generation of heat is defined, 
in our microscopic formulation, by 

Of) = T"^ ; U ( t ) = ™(t)PsymP(t)=Tr(P sym n(t))p(t)=Trn oP (t), 

(26) 

where P sym denotes the projection operator to the symmetric (or even) part 
of the relevant operator with respect to the inversion of space or the external 
field E. In fact, the entropy should be independent of the sign of E. There- 
fore, it should be an even function of E. Thus, it is described by p sym (t) 
defined by Eq. (136bj) . The definition of U(t) in terms of Eq. (l26|) (not defined 
by the total Hamiltonian) is essential for the following argument. It is also 
instructive to rewrite Eq. (12611 in the form 



(^) =- fc B|Trp(t)P sym (log Ploc ), (27) 

using pi oc given by Eq. flTB"]) . 

As mentioned in the preceding section, the linear-response density matrix 
Pi r (i) given by ([3]) and © does not give a finite contribution to the entropy 
production ( 12"B"|) . because of the difference of symmetries between "H an d "Hi 
(or pi(t)). In this situation, we dare to try to study the contribution of the 
second-order term P 2(t) to f f26|) . 

In general, we expand pit) as 

p(t) = Po + Px {t) + p 2 (t) + ■■■ + p n (t) + ■■■ . (28) 
From the von Neumann equation (JTJ), we obtain the following hierarchical 
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equations 



i^Px(t) = [Ho,Pi(jt)] + ['Hi(t),p ], 
ih^pi(t) = [H ,p 2 (t)} + [Hi(t), Pl (t)], 



d 

ih— Pn {t) = [H ,Pn(t)] + [^i(t),p„-i(t)]. (29) 

A solution of Eq. (1291) is given in the form 

Pn(t) = T t {p n -x{t)) = ^T 1 (Pi(t)) = 7? (Po) , (30) 
where ^ 

jr t (Q(t)) = l f Uo(t-s)[Hi(s),Q(s)]l4(t-s). (31) 

ltl Jtn 



In particular, we have 

P2(t)=J r t(pi(t))=^( P0 ) 

= (J^JdsJds'Uo{t - - sO[^i(AA)]z4(s - J)M(t - s). 

(32) 

Now, we calculate the change of the internal energy, U'(t), using Eq.(l32l. 
However, this is rather complicated. We find that it is much easier to make 
use of the algebraic equation of the derivative p' 2 (t), namely Eq. (l2"9l . Thus, 
we arrive finally at 



fdS(t)\ 1 dU(t) _ 1 d(H ) t _ 1 

\m~L ~ ~~~~ 



T dt T dt T ™Mt) 
= ^TvU 1 (t)p l {t) = ^TvA.E Pl (t) 

= ?f > 0, (33) 

using the expression of a in Eq. ffTO]) or using the relation J = aE, as far 
as the second order of E is concerned. The time dependence of temperature 
T comes from the order E 2 and consequently this correction becomes of the 
order E 4 in Eq.( l3"3"j) . as is discussed below. 
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Now, the time dependence of T(t) is effectively defined by the equation 
U(t) = (H )o(T(t)) = TrUoexp (-/3(t)^ ) /Z (f3(t)), (34) 

with f3(t) = l/k B T(t), and Z ((3) = Tr exp(— /3"H ), in a slowly varying state. 
This is a convenient parameter to characterize "thermodynamically" non- 
equilibrium systems, which is expected to be observed experimentally with 
respect to the change of the internal energy. Then, T(t) is expanded in 
the form T(t) = T + a(t)E 2 + ■ ■ • . Thus, the entropy production f l33]) is 
time-independent in the lowest order. 

In general, according to the symmetry arguments on Hq an d the current 
operator j = A, we find that the average of the current, J Eif) = (j)t = 
Trjp(t), is expressed by 

J E (t)=Trjp*{t), (35) 
using the antisymmetric part p^it) of pit) given by 

Pa(t) = \ {P^, E) - pit; -E)} = P antisym p(t) = Pl (t) + p 3 (t) + ■■■ , (36a) 

and that the entropy production is given by (dS/dt)i TT = TrT-L p' s it)/T using 
the symmetric part 

Ps{t) = \ {p(t; E) + p[t- -E)} = P sym p(t) = po + p 2 (t) + ■■■ . (36b) 

We note here that these partial density matrices satisfy the following "pro- 
jected (symmetry-separated) von Neumann equations" 

^Pa(t) = [Ho, PaOO] + [Hx(t), p s (t)\, (37a) 

and 

z^p s (£) = [HoiPM + [«i(t),/>a(f)]. (37b) 
These are written in the following unified form 

th^p q it) = [Ho, Pq it)} + IMt), (1 - P q )pit)}, (38) 

where q denotes "sym" or "antisym" and P q is the projection operator to the 
"q" part of the density matrix p(t); P ? 2 = P q and P sym + P a ntis y m = 1- This 
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separation of symmetric and antisymmetric parts of p(t) is shown to play 
an essential role in formulating steady states as is seen in the succeeding 
sections. 

Using these partial (projected) density matrices, the general current J e, 
conductivity <je and entropy production {dSjdt\„{E) are expressed, respec- 
tively, as 



for an arbitrary strength of the electric field E, as far as the entropy change is 
defined by (dS / dt)- 1TT (E) = TrH //(t)/T(t) in a non-stationary state, and as 
far as the definition of T(t) in Eq. (l34|) is justified in a slowly- varying region. 

Thus, the entropy production associated even with the linear transport 
phenomena is given by the time derivative of the second-order density matrix, 
p' 2 (t). That is, the linear response scheme is closely related to the higher-order 
terms of the density matrix, when we discuss the relation between transport 
phenomena and the irreversibility associated with them. 

As is seen from Eqs.(|39l) and ( )4T|) . the current and entropy production 
are dual through the conductivity whose finiteness (<te > 0) is the essence of 
irreversibility. 

5. New schemes of steady states using relaxation-type von Neu- 
mann equations 

In the preceding section, we have discussed a non-stationary state in 
order to clarify the entropy production of the relevant system described by 
the Hamiltonian H(t) = Hq + Hi with a static electric field E; Hi = —A-E. 
In fact, the electric power (given by ("Hi)) is transformed into the internal 
energy U(t) = (Ho)t (or heat-energy) inside the system described by %q (even 



Je = Trjp a (t) = a E E, 

a E = a + a 2 E 2 + ■■■ + a 2n E 2n + ■ ■ ■ ; a = a, 



(39) 
(40) 



and 




(41) 
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without interactions of it with the heat bath). Thus, the entropy production 
is derived from the Hamiltonian "H i n the thermodynamic limit and then in 
the limit to — oo (corresponding to the coarse graining of time) with an 
adiabatic factor e~ et (e > 0) if necessary. 

In the present section, we study the entropy production in steady states 
corresponding to more realistic situations. For this purpose, we have to 
introduce explicitly the interaction of the system with the heat bath, in 
order to extract generated heat outside of the system. For this purpose, we 
extend the von Neumann equation p]) as follows: 

^- = ^mt),P(t)]-T(p(t)), (42) 
where the relaxation term T(p(t)) may be given in the Lindblad form(l8|: 



np) = Y,{ v ^-\{ v ^p) 



(43) 



However, we are now interested only in the conceptual mechanism of the 
entropy production in steady states. Thus, we make use of the simplest 
form of T, under the consideration of the essential difference between the 
symmetric density matrix p s (t) and antisymmetric one p a (t) introduced in 
the preceding section. It should be remarked that the current is related to 
the conservation of particles or charges, and consequently that it is expressed 
easily by a kind of non-equilibrium density matrix including current operators 



easily py a 

0, 0, 



20|. Only the adiabatic factor e~ et may be necessary for the 
convergence of the integral of the time-correlation function of the relevant 
current, which is described by p a (t). Thus, we assume, for T, 

rpa(t) = epa(t) (e->+0). (44) 

Although the total energy is a conserved quantity, the entropy (or heat) 
is not so. The entropy characterizes a qualitative property of the energy in 
non-equilibrium states. (Of course, it is more strictly defined as a thermo- 
dynamical state quantity in an equilibrium system.) Therefore, we have to 
treat the heat change in a quite different way from the current. The gen- 
erated heat of the system should be extracted outside at a finite speed to 
construct a steady state and it is expressed by the change of p s (t). Thus, we 
assume 

Tp s (t) = e r (p s (t) - p ); e r = -. (45) 
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The relaxation time r r in Eg. ( 1451) is macroscopic, namely much larger than 
the collision time r of electrons colliding with impurities or phonons (i.e., 
r <C r r ), See Appendices A and B, concerning the physical role of the collision 
time r. 

More explicitly we may write in the following: 

j t p a (t) = ±[U ,p a (t)} + - ep a (t), (46) 

and 

j t p s {t) = ±[U , Ps {t)\ + ^HupM - e r (p s (t) - pa) . (47) 

In a unified way, we have Eq. (jl2"]) with Tp(t) = T (p a (t)) + r(p s (t)). The 
trace conservation of the density matrix p{t) = p s (t) + p a (t) and its positivity 
are easily proved, as in the case of the Lindblad form ( 1431) . Thus, we obtain 
the differential equation of the internal energy U(t) for ~Hi = —A ■ E as 

jU{t) = J E (t) -E-e T (U(t) - [/(t )) , (48) 

using the relation 

lTr^o[^i, pM = -Ttfiip a (t) = Tr(j ■ E)p a (t) = J E (t) ■ E. (49) 
The solution of Eq. ( 1481) is given by 

U(t)= [ e- tl{t ~ s) J E (s)-Eds + U{t ). (50) 

J to 

From Eqs.( T46l) and ( T4T1) in the limit t — >■ oo, we obtain the stationary density 
matrices pi st ^ and pi : 



;i - A^BC^Vyipo, and p a st) = C~ X V{\ - ^RT^rV (51) 



and thereby we can evaluate the stationary values and U^ st \ Here, the 
hyper-operators A, B, C and V are defined by 

A=l- u T 5 Ho , B = u r 5 Hl , C = 1 - w e <$«o , and V = u e 5 Hl , (52) 

where u e = l/(ihe),u T = l/(ihe T ) = T T /(iK) and the inner derivation Sq is 
defined by fl5l| 

S Q R = [Q, R] = QR - RQ. (53) 
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The inverse hyper-operators A 1 and C 1 are defined in a power series as 

oo 

A' 1 = (1 - u^r 1 = 1 + Mw ) n etc. (54) 

n=l 

For example, we have 

p! St) = z ] -^u e 5 Hl p = I dtexp (^Suo J ( i[Wi,po] J e" e * 

poo p/3 

dt d\j(-t-ih\) ■ Ee~ e \ (55) 
Jo Jo 



= Po 
and 

P? ] = dtexp (-(e r - l^t) (hHi, p? ] ]) . (56) 

Explicit applications of these results to the entropy production will be 
presented in the next section. (Note that B~ l and T>~ x can not be defined.) 

6. Dynamical-derivative representation method to reveal the irre- 
versibility and entropy production of steady states 

In the preceding section, we have made a formulation of the steady states 
Ps St ' ) and pa ■ Then, the averages of the current and the internal energy 
are given, respectively, by 

jg*) = Trjpi st ) and U {st) = TrH p( st ). (57) 

Correspondingly, the stationary temperature T st is expressed using the rela- 
tion 

(^o)o(T st ) = t/ (st) = f/ (st) (r r ), (58) 



as a function of the relaxation time r r . More explicitly, from Eq. ff48|) . we 
obtain the relation 

(n )o(T st ) - (n Q )o(T) = - U(t ) = r T J% t] ■ E (<= TrT-^PBt) • E) . 

(59) 

This relation is also confirmed using Eqs. (155]) and ( 15 6|) up to the second order 
in E and it gives the expression of T st as T st = T + r T aE 2 /C(T) + 0(E A ) 
with the specific heat C{T) of the system described by T-L . Namely, the 
change of the stationary internal energy is given by the nonlinear Joule heat 
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per unit time multiplied by the relaxation time r r , as is expected physically. 
Note that T st = T only when r r = 0. This condition (r r = 0) corresponds to 
the instantaneous extraction of generated heat outside of the system. This is 
practically impossible. We have T st > T (i.e., r r > 0) in a realistic situation. 

Next, we study the entropy change (dS / dt)- lTT in the stationary state. At 
a glance, it seems difficult to calculate from the time change of the internal 
energy ( H5|) . because the dU{t)/dt goes to zero in the steady state. In order 
to overcome this difficulty, we study the right-hand side of Eq.( l48|) from a 
physical point of view. The first term J E{t) ■ E of it is expressed in the form 



J E (t) ■ E = TiH D d (p(t)) = Tr(D d H )p(t), (60) 



where 



D d H = ^\UoMt)l and D d (p(t)) = ±r[H(t),p(t)] = ^ + T(p(t)), 

(61) 

as is easily seen from the derivation of Eq. fj48|) from Eq.(l47p. Here, the 
hyper-operators D d and D d denote the time derivatives of the density ma- 
trix and an operator, respectively, in the above sense ( 16T1) . We call these 
as "dynamical-derivative representations", which may correspond to an in- 
termediate representation between the Heisenberg and Schrodinger represen- 
tations. Note that the hyper-operator D d defined by (i/h)5u(t) satisfies the 
Leibniz rule D d (AB) = (D d (A))B + A(D d (B)), similarly to ordinary differen- 
tial operators. We remark here that D d (A) is generally different from the time 
derivative A defined by A = (ih^S^A, but it happens that D d {l-Li) = Hi 
toTH = U Q + Hx. 

The mechanism of heat generation should be the same as in the absence 
of the relaxation term Tp(t). Consequently, the entropy production in our 
new situation described by Eq. fj47|) is expressed in the form 

—J (t) = TrSD d p(t) = — Tr(4i(Ho))p(t) = (J E (t) ■ E) /T(t), (62) 

with the time-dependent temperature T{t) defined by Eq. (lM|) . namely 

(Ho)o(T(t)) = U(t) = (Ho) t = TrHop(t), (63) 

together with Eq.( l50|) . Thus, the temperature T(t) defined by Eq.( |63l) be- 
haves like FigHJ In order to emphasize the logic of our theory, we rewrite 
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Fig. 1: Schematic figure of the time dependence of the temperature T(t) of the system. 



Eq. (l48p in the following form 




= (Tr(4(«o))p(f)) 



generated heat 



( 



U(t) - U(t ) 



) 



extracted heat 



(64) 



which vanishes in the steady state, owing to the balance of the two terms 
in the right-hand side of Eq. fl64|) . It should also be emphasized that the 
extraction of heat energy in Eq.f l6~4"|) is given by the symmetric part p sym (t) 
through (p sym (t) - Po)/t t . 

7. Summary and discussion 

In the present paper, we have succeed in deriving, from first principles, 
the entropy production in transport phenomena for a typical example of 
static electric conduction. This yields a direct derivation of irreversibility 
in transport phenomena. It is very interesting that the second- order term 
P2{t) of the density matrix gives the lowest-order contribution to the entropy 
production. Of course, it is expressed finally by the first-order p\ (t) produced 
by %i(t), and any higher-order contribution can be expressed by the multiple 
integrals of commutators of pi(t) with {Hi(t)}, as shown in Eq. (l30l) . After 
the discovery of the present derivation of the entropy production in transport 
phenomena, it seems to be quite natural, because the entropy production is 
a symmetric (and consequently even) function of an external force F (or E 
in the case of electric conduction) and consequently because the lowest-order 
contribution should start from the second order in F (or E), as was already 
discussed phenomenologically by many authors (see Section 3). 
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In any way, the present discovery of the appearance of entropy production 
in the second-order term of the density-matrix expansion is one of the very 
rare cases in which the essence of each physical phenomenon appears in 
the second-order term of each perturbational expansion, as in the Kondo 



effect 21j and in the negative divergence of the nonlinear susceptibility of 



spin glasses at the transition point 22 



It is also instructive to remark that the irreversibility and entropy pro- 
duction are based on the existence of the non-vanishing and finite transport 
coefficients (such as the conductivity a), as has been already briefly men- 
tioned in Section 2 concerning the order of taking the two limiting proce- 
dures the volume V — > oo and the initial time to ~~ ► — oo. This yields the 
statement that the irreversibility is assured by the inequality A s < A t of 
the two scaling exponents A s and A t of the space scaling x' = x/e Aa and 
time scaling t' = t/e At for small e (e > 0), concerning the equation governing 
the relevant intrinsically irreversible phenomenon. For a diffusion process 
(a typical irreversibility process), for example, we have A t = 2A S , because 
(Ax) 2 ~ (At) in this case. Thus, space and time have quite different char- 
acters in the theory of probability (or stochasticity) and entropy production. 
Note also that the above condition A s < A t is satisfied in difference equations 
in which chaotic phenomena (and consequently irreversible phenomena) are 
apt to occur. When the relevant current operator contains partially a con- 
stant of motion, there appears the problem of ergodicity concerning linear 
responses and possible constants of motion (23|. 

By the way, it may be interesting to remark that 

TXHi(t)fL-i(t) = -TXHoFbV) = TrH 1 (t)p 2n _ 1 (t), (65) 
for all n, and consequently that 

Tt«i(Va(*) = -™oPs(*) = = (A(t))t 

= -j t (Uo} t = -(U o y t ; p'(t) = j t p(t). (66) 

These relations yield again the proposition that the time derivative of the 
relative entropy ff23l) defined by the total Hamiltonian always vanishes, if 
the contribution of the second-order term is also included, as was briefly 
mentioned in subsection (3.4). 

Physically speaking, the quantity (%iit)) t = TYl-Li(t)p'(t)(< 0) denotes 
the loss of electric power inside the relevant system, which is implicitly as- 
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sumed to be compensated from outside, in order to keep the electric cur- 
rent. To understand this situation more clearly, the waterfall analogy will 
be helpful, as is often used. The gravitational energy of water (—^electric 
field effect) is transformed into the kinetic energy of the water changing into 
heat (— ^internal energy) at the bottom of the waterfall and consequently the 
temperature there increases. However, at the top of the fall, water should be 
supplied (from a river or a lake) to keep the stream of the waterfall. 

As has often been explained from the energy balance, the reader might 
insist that the loss of electric power, (%i)t(= —J ■ E) should express the 
energy dissipation and that it can be calculated by pi(t). However, logically 
speaking, the loss of electric power might change to mechanical energy, which 
does not necessarily mean immediately the generation of heat energy. In fact, 
many people including the author have not been satisfied with the argument 
due to the above energy balance. The essence of irreversibility should be 
explained directly by the generation of heat inside the system in the case of 
electric conduction. The change of the internal energy (7io)t corresponding 
to the heat energy is logically derived from the time derivative of the second- 
order (symmetric) term p2{t) of the density matrix, and consequently that it 
is finally equivalent to the quantity —{ / Hi)t{> 0). 

The reader might say that the relation (7io)t — ~ (%i)t is nothing but the 
energy conservation. It is true in the isolated system ([1]). However, it comes 
from the exact unitary evolution of the density matrix p(t). To prove this 
explicitly requires the calculation of (H + %\)t up to the second order of an 
external field, using p + pi(t) + p2(t), even in the lowest-order argument, be- 
cause TrH Q pi(t) = from the symmetry argument. Anyway, we have to use 
the symmetric part of p(t) in order to discuss the energy change and entropy 
production. Thus, the present direct derivation of the internal (heat) energy 
using the symmetric part p sym (t) manifests the irreversibility of the electric 
conduction. This observation has inspired the author to find the symmetry- 
separated relaxation-type von Neumann equation. This symmetry-separated 
treatment of p(t) is crucial in formulating non-equilibrium steady states with 
entropy production, as has been presented in Section 6. The present theory 
insists that the internal energy is derived logically from the second-order or 
higher-order symmetric density matrix p sym _(t). 

In our system of electric conduction (or any other transport phenomenon), 
we assume that our system is infinite to avoid the problem of boundary 
conditions and to assure the irreversibility of these processes. 

It should be emphasized again that our argument on the irreversibility 
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and entropy production has become remarkably transparent by confining our 
explicit analysis in a typical example of static electric conduction and fur- 
thermore by treating first a non-stationary state and then as simple steady 
states as possible. Such a stationary density matrix formalism as gives the 
entropy production has been constructed in the present paper. More explic- 
itly, pi agrees with Kubo's expression (Eq.flSBJ). However, {pl st) (n > 2)} 
contain the parameter r r which controls the speed to extract heat outside. 

Thus, the two research trends of Prigogine's non-equilibrium thermody- 
namics based on the entropy production (irreversibility) and Kubo's linear 
response framework are now integrated by clarifying the role of symmetry 
of non-equilibrium states (i.e., p a (t) for current and p s (t) for irreversibility, 
showing duality). 

The present theory j24j can be easily extended to more general transport 
phenomena (including more complicated non-linear transport phenomena [25|) 
in non- stationary and steady states both with electric and heat currents, in 
which Onsager's reciprocity relations and the KMS condition will be extended 
as will be reported in the near future. 
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Appendix A. Derivation of entropy production using the relaxation- 
type Boltzmann equation 

As has been explained in detail in Sections 4,5 and 6, the generation of 
heat or entropy production occurs inside the system described by "Ho- In 
order to illustrate this situation more intuitively, we discuss the electric cur- 
rent and entropy production using the following "relaxation-type Boltzmann 



equation" [z| 



df(t) 



+ v- 



df(t) 



+ eE- 



df(t) 



1 



(/(*) - fo) 



(Al) 



dt 



dx 



dp 



T 
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for the distribution function of electrons, f(t). In the present uniform case, 
the second term of the left-hand side of Eq. tlA.ip vanishes. We expand f(t) 
as 

/(t) = /o + /i(t)+/ 2 (t)+---. (A.2) 
If we note the relation e = p 2 /2m, the third term of the left-hand side of 
Eq. (1A.ll) is expressed in the form 

eE .m =ev . E v (A .3) 

Op Oe 
The first-order equation of Eq. flA.lj) is given by 

/l(e) (st) = _ rev . = r{j . E) p fQ (A . 4) 

in the steady state. Then the stationary current is given by 

/2 
ev& t} {e)D{e)de = — £ = aE, (A.5) 
m 

as is well known. Here, D(e) denotes the density of states, and r is the 
collision time of electrons, which should be calculated, in principle, from the 
Hamiltonian "Ho- 

The second-order equation of Eq. (1A.1I) is given in the form 

f + ev . E f = .L h , (A.6) 
ot Oe r 

Then, we obtain 

(m) heat gen . = lft\e) = -u ■ ^)^— - m ■ E)ft\ (a.7) 

It is easily shown that the entropy production defined by 



(§) [4f^,t))D(e)de, 

\ 0,1 /irr 1 J V /heat gen. 



(A.8) 



is given by 



(f ) 0eU • E )fi St) ^)D(e)de * I(JW ■E) = ^f, (A.9) 

which agrees approximately with the expression obtained in the text. The 
present argument yields again our statement that the entropy production is 
derived from the second-order term of the distribution function or the density 
matrix. 
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Appendix B. Einstein-Onsager Ansatz and Relaxation-time Ap- 
proximation of <j in the Kubo formula 

It may be instructive to rederive Eq. (jA.5|) from Eq. ffTOl) using Einstein's 
theory of Brownian motion (26|: 



dv 



m- 



3 



dt 



-(vj + rjM + F (B.l) 



for the velocity Vj of the j-th particle with the Gaussian white noise 77 - (t) 
satisfying the relation 

(r ]j (t)r 1j (t'))=2e'5(t-t'). (B.2) 

Here, F denotes an external force and we assume F = eE in our static elec- 
tric conduction. If we take the average of Eq.f lB.lj) and take the summation 
of the whole electrons in unit volume, then we obtain 

lj(jt) = - 1 J{t)+(^)E ] 7=- (B.3) 
dt \ m J m 

Thus, the macroscopic relaxation law is the same as the microscopic one 
( IB.lj) except the noise Tjj(t) in the linear regime. Physically speaking, this 
should be stated inversely. That is, the introduction of the systematic force 
— Cvj (whose coefficient is identified as the macroscopic one) in Eq.f lB.lj) 
is due to Einstein's drastic intuition. This idea was also effectively used by 
Qnsagerflil in deriving the reciprocity theorem. This may be called Einstein- 
Onsager ansatz. In the steady state, we arrive at 

J( st > = a E; a = = r, r = -. B.4 

7717 m 7 

This agrees with Eq.( 1A.5l) . as it should be. Similarly we obtain the current- 
current correlation 

j t (j(t)j(0))o = -l(j(t)j(0)} (B.5) 

from Eq. flB.lj) in the absence of an electric field. The average (• ■ ■ )o denotes 
the thermal average for E = at the temperature T. The solution of fIB.Sj) 
is given by 

(mmh = </(0)>oe^ = ™^L e -*. (B.6) 

m 
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This yields again Eq. (1A.5j) using Eq. (ITU|) in the classical limit % — > 0. By the 
way, the strength e' of the noise is easily shown to be expressed as 

e = k B T( = k B Tm-f (B.7) 

This is nothing but the classical fluctuation-dissipation relation Q. 
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